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Vid ett satt att matcha tva bilder av kroppsspeci- 
fika mOnster, vilka bilder var och en bestir av ett fler- 
tal bildpunkter och har delvis overlappande innehall, be- 
stams graden av Sverensstammelse mellan bildernas inne- 
hall for olika ffcrskjutningspositioner som representerar 
olika Overlappningar mellan bilderna. Mera i detalj be- 
stams ett f lertal tal for var och en av ett ^lertal av 
namnda fSrskjutningspositioner . Vart och ett av talen 
bildas med hjaip av bildpunktsvfirden fran bada bilderna 
och anvands ffir att samtidigt fi fram 1 forvag definie- 
rade Overlappningsbedomningsvarden for minst tva av 
namnda fSrskjutningspositioner. De hamtade overlapp- 
ningsbed5mningsvardena anvands sen f&i att bestamma 
graden av overensstammelse mellan bilderna for de olika 
fttrskjutningspositionerna. sattet genomfors med en dator 
och kan implementeras som ett datorprogram. 
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Uppf inningens omrade 

Foreliggande uppfinning avser ett satt och en anord- 
ning for att matcha tva bilder av kroppsspecif ika mons- 
ter, vilka bilder var och en bestar av ett flertal bild- 
punkter och har del vis overlappande innehall, varvid 
graden av overensstammelse mellan bilderna bestams for 
olika forskjutningspositioner som representerar olika 
overlappningar mellan bilderna. 
Bakgrund till uppfinninqen 

Det ar kant sedan hundratals, ja kanske torn 
tusentals, ar tillbaka att en persons f ingeravtryck ar 
unika och darfdr kan anvSndas for att identifiera per- 
sonen ifraga. Tekniken har hitintills mest anvants for 
att identifiera brottslingar, men det ar aven kant att 
anvanda den i exempelvis passersystem. Nar tekniken an- 
vands i passersystem trycker personen som skall godkannas 
for passage sitt finger mot en yta, varvid det tas en 
bild av fingeravtrycket. Denna bild jamfors med ett antal 
i forvag lagrade f ingeravtrycksbilder for godkanda perso- 
ner for att avgora om personen i fraga skall tillatas 
passera eller e j . 

Vid jamforelsen anvands i regel s k feature extrac- 
tion, som innebar att vissa karaktaristiska punkter i 
avtrycket identifieras och att punkterna och dessas in- 
b6rdes avstand jamfors med motsvarande data for de i for- 
vag lagrade fingeravtrycken. Ett problem i samband med 
jamforelsen ar att fingeravtrycket vanligtvis inte bef in- 
ner sig i samma lage i bilden som tas nar identif ieringen 
skall utforas som i den i forvag lagrade bilden av 
fingeravtrycket. 
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sakerheten i systemet okar naturligtvis ju mer data 
som undersoks, men k andra sidan okar ocksS tiden for 
identifieringen. Det finns darfor ett stort behov av ett 
satt att snabbt och effektivt matcha f ingeravtryck med 
varandra. 

P& senare tid har man aven borjat anvanda andra 
kroppsspecifika mSnster, sAsom hand- och fotavtryck, och 
irismonster, for identif iering av personer. Vid dessa 
tiliampningar finns det givetvis samma behov av att 
snabbt matcha bilder med varandra. 

Ett tankbart satt att matcha tv& bilder av kropps- 
specifika mSnster ar att undersoka alia mojliga 5verlapp- 
ningspositioner mellan bilderna och att for varje Sver- 
lappningsposition undersoka samtliga par av overlappande 
bildpunkter, bestamma en poang for varje par av overlap- 
pande bildpunkter, varvid poangen beror pk hur val bild- 
punkternas varden overensstammer med varandra, och att 
sedan bestamma vilken av overlappningspositionerna som 
ger den basta Sverensstammelsen pa basis av summan av 
poangerna for de overlappande bildpunkterna i varje posi- 
tion. Detta ar emellertid ett alltfor langsamt forfarande 
for den ovan angivna tiliampningen. 
Sammanfattninq av uppfinningen 

Mot bakgrund av ovanst&ende ar ett andamal med fore- 
liggande uppfinning sSledes att anvisa ett nytt satt for 
automatisk matchning mellan tvi bilder av kroppsspecifika 
mSnster, vilket satt mGjliggSr snabbare matchning av 
bilderna med en given processor an ovan beskrivna satt. 

Ett ytterligare andam&l ar att Sstadkomma en anord- 
ning f&r genomf6rande av sattet. 

Andam&len uppnis med ett satt enligt patentkravet 1 
och en anordning enligt patentkravet 17 och enligt pa- 
tentkravet 18. Foredragna utf Gringsformer anges i under- 
kraven. 
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Uppfinningen bygger liksom tidigare p& att graden av 
overensstammelse mellan tvS bilder av kroppsspecif ika 
monster, vilka var och en bestir av ett flertal bild- 
punkter och har delvis Overlappande inneh&ll, bestams for 
olika fOrskjutningspositioner som representerar olika 
Overlappningar mellan bilderna. JamfOrelsen av innehSllet 
i bilderna utfOrs emellertid p<S ett effektivare satt. 
Mera specifikt bestams ett flertal tal for var och en av 
ett flertal fOrskjutningspositioner, vilka tal vart och 
ett bildas med hjalp av bildpunktsvarden fran bida bil- 
derna. Talen anvands far att samtidigt fa fram i fOrvag 
definierade OverlappningsbedOmningsvarden for minst tv£ 
fOrskjutningspositioner , Dessa OverlappningsbedOmnings- 
vSrden anvands sedan vid bestamningen av graden av Over- 
ensstammelse mellan innehallet i bilderna. 

Med detta satt kan de olika forskjutningsposition- 
erna undersokas med en viss grad av parallellitet, vilket 
gor det mOjligt att undersOka bilderna snabbare an om 
alia fOrskjutningspositionerna undersOks sekventiellt . 
Denna parallellitet uppnSs med hjalp av talen, som an- 
vands fbr att samtidigt undersoka minst tv& forskjut- 
ningspositioner. Eftersom talen ar baserade p& innehSllet 
i respektive bild kan man p£ fOrhand rakna ut Overlapp- 
ningsbedomningsvarden for de fall dfi bildpunktsvardena 
som bildar talen Overlappar varandra helt eller delvis. 
Ef fektiviteten Okar givetvis ju flera bildpunkter som 
ingir i varje tal eftersom detta Okar parallelliteten. 

OverlappningsbedOmningsvardena ar alltsA definierade 
i fOrvag. Harmed avses att om en bildpunkt i den ena 
bilden har ett fOrsta givet varde och motsvarande Over- 
lappande bildpunkt i den andra bilden har ett andra givet 
varde erhilles alltid ett visst i forvag bestamt Over- 
lappningsvarde. Motsvarande galler nar Overlappningsbe- 
dOmningsvardena avser flera Overlappande bildpunkter. De 
olika OverlappningsbedOmningsvarden som erhills fOr olika 
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kombinationer av bildpunktsvarden kan bestammas fritt. De 
kan definieras med hjalp av en eller flera formler eller 
tabeller eller pi nagot annat lampligt satt. 

Det skall i sammanhanget p&pekas att bilderna natur- 
5 ligtvis inte f6rskjuts fysiskt i forhillande till var- 
andra vid genomf Orande . av sattet, utan att jamforelsen 
mellan bilderna sker for tankta forskjutningar . 

I ett foredraget utfOrande innefattar sattet vidare 
stegen att summera OverlappningsbedOmningsvardena for var 

10 och en av nSmnda f Orskjutningspositioner, och att anvanda 
de s&lunda erh&llna summorna for bestamning av vilken av 
f orskjutningspositionerna som ger den basta mojliga 
Overensstammelsen mellan inneh&llet i bilderna. De Over- 
lappningsbedOmningsvarden som summeras fOr en viss for- 

15 skjutningsposition aterspeglar f oretradesvis overens- 
stammelsen mellan samtliga Overlappande bildpunkter for 
den forskjutningspositionen. 

For att ytterligare Oka hastigheten fOr matchningen, 
summeras OverlappningsbedOmningsvardena lampligen paral- 

20 lellt for ett flertal fOrskjutningspositioner . Summe- 

ringen blir speciellt fOrdelaktig om den gOrs parallellt 
f5r de overlappningsbedomningsvarden som hamtas samtidigt 
med hjalp av ett tal. 

Varje OverlappningsbedOmningsvarde kan avse en eller 

25 flera Overlappande bildpunkter. I det senare fallet upp- 
nSs en okning av matchningshastigheten genom att man inte 
behOver addera bedOmningsvarden fOr varje Overlappande 
bildpunkt for en viss f Orskjutningsposition utan redan 
adderade OverlappningsbedOmningsvarden for tvA eller 

30 flera Overlappande bildpunkter kan hamtas direkt. 

Det flertal fOrskjutningspositioner for vilka tal 
bestams kan lampligen utgOra grovf Orskjutningspositioner, 
och namnda minst tva fOrskjutningspositioner for vilka 
Overlappningsbedomningsvarden hamtas kan lampligen inne- 

35 fatta minst en f inf Orskjutningsposition, som represente- 
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rar en mindre forskjutning fran en grovferskjutnings- 
position an fOrskjutningen mellan tva grovferskjutnings- 
positioner. Det andra hamtade c-verlappningsbed6mnings- 
vardet kan avse den aktuella grovf orskjutningspositionen 
eller en annan f infbrskjutningsposition. 

I det enklaste utfbrandet av sattet 3r bildernas 
innehall forskjutna i forhallande till varandra i enbart 
en riktning. sattet kan emellertid aven utnyttjas nar 
bilderna ar fdrskjutna i tva olika, foretradesvis vinkel- 
rata, riktningar i fbrhallande till varandra. F6r att man 
i detta fall skall fa fram den position i vilken Overens- 
stanunelsen mellan bildernas innehall ar maximal, later 
man lampligen grovf brskjutningspositionerna representera 
olika overlappningar mellan bilderna i den fOrsta rikt- 
ningen, exempelvis i horisontell led, och upprepas sattet 
for olika Overlappningar mellan bilderna i den andra 
riktningen, exempelvis i vertikal led. 

Grovfdrskjutningpositionerna, som alltsa utg&r en 
delmangd av de undersokta fdrskjutningspositionerna, 
bestams f oretradesvis genom att bilderna delas in i ett 
flertal grovsegment som bestar av N x M bildpunkter dar N 
och M ar storre an ett, varvid fQrskjutningen mellan tva 
angransande grovforskjutningspositioner utgdrs av ett 
grovsegment. Grovsegmenten kan alltsa astadkommas genom 
att bilderna delas in i kolumner eller rader, som var och 
en har ett flertal bildpunkters bredd resp hojd. 

Bilderna kan vara representerade pa olika satt. De 
kan vara analoga, men ar foretradesvis digitala eftersom 
de da blir enklare att behandla med hjalp av en dator. 
Bildpunktsvardena kan representeras med olika upplosning. 
Sattet ar dock foretradesvis avsett for bilder som rep- 
resenteras som bitmappar. 

Talen ar sasom namnts baserade pa innehallet i de 
bada bilderna. I en fOredragen utforingsform anvands 
talen som adresser till minnesplatser, som lagrar ever- 
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lappningsbedomningsvardena. I detta fall ar dessa lamp- 
ligen definierade genom att de helt enkelt ar utraknade 
eller bestamda i forvag. 

Adresserna anvands foretradesvis for att adressera 
5 en uppslagstabell som, for varje adress, innehaller 

namnda i forvag utraknade overlappningsbedomningsvarden 
for minst tva f Srskjutningspositioner . Den ordning i 
vilken bildpunktsvardena anvands i adressen saknar be- 
tydelse sa lange samma ordning anvands for alia adresser 
10 och sa lange lagringen av overlappningsbedOmningsvardena 
i uppslagstabellen gors pa ett forutbestamt satt i for- 
hallande till denna ordning. 

Sattet enligt uppfinningen kan implementeras helt i 
hardvara. I detta fall kan talen exempelvis bilda insig- 
15 naler till en grindmatris som har utformats pa sa satt 
att man for varje given uppsattning insignaler far fram 
motsvarande overlappningsbedomningsvarden som utsignaler. 
I detta fall ar alltsa 6verlappningsbed6mningsvardena 
definierade genom grindmatrisens utformning. Detta satt 
20 kan vara fordelaktigt for storre bilder. 

I ett foredraget utforande genomfOrs emellertid 
sattet i mjukvara med hjalp av en processor som arbetar 
med en fbrutbestamd ordiangd. Uppslagstabellen innef attar 
da ett flertal adresserbara rader, som var och en har den 
25 forutbestamda ordiangden och som lagrar de i fSrvag ut- 
raknade overlappningsbedomningsvardena. Genom anpassning 
av tabellbredden till processorns ordiangd erhalles basta 
mojliga utnyttjande av processorns kapacitet. Exempelvis 
kan man pa ett effektivt satt summera olika rader i 

30 tabellen. 

De olika parametrarna for sattet, dvs grovf drskjut- 
ningspositionema, antalet f5r varje adress lagrade 
6verlappningsbed6mningsvarden f antalet tabeller osv be- 
stams lampligen utifran den anvanda processorn och dennas 

35 cache-minne far uppnaende av httgsta mdjliga snabbhet. 
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Foretradesvis valjs parametrarna pa sa satt att bada 
bilderna och samtliga de i fOrvag utraknade Overlapp- 
ningsbedomningsvardena ryms i cache-minnet . 

I ett fOredraget utfOrande bildas varje tal av ett 
fOrsta finsegment, som innef attar minst tva angransande 
bildpunktsvarden fran den forsta bilden, och av ett andra 
finsegment, som Overlappar det forsta finsegmentet och 
som innefattar lika manga angransande bildpunktsvarden 
som det fOrsta finsegmentet fran den andra bilden, samt 
av ett tredje finsegment, som innefattar lika manga an- 
gransande bildpunktsvarden som det forsta finsegmentet 
fran den andra bilden och som overlappar det forsta fin- 
segmentet i en intilliggande forskjutningsposition for 
vilken bestamningen av ett flertal tal utfOrs, dvs en 
intilliggande grovforskjutningsposition. Pa detta satt 
kommer talet att inkludera alia bildpunktsvarden som kan 
Overlappa varandra i en grovforskjutningsposition och i 
alia finforskjutningspositioner mellan denna grovfor- 
skjutningsposition och foljande grovforskjutningsposi- 
tion, samt i denna foljande grovforskjutningsposition. 
Harigenom kan man alltsa med talet hamta i fOrvag ut- 
raknade overlappningsbedOmningsvarden f6r samtliga dessa 
forskjutningspositioner . 

For att spara minnesutrymme sa att all erforderlig 
information kan lagras i en processors cache-minne och 
darigenom vara snabbt atkomlig, delas med fOrdel varje 
adress upp i en forsta och en andra deladress, varvid den 
fOrsta deladressen, som bestar av bildpunktsvardena fran 
det fOrsta och det andra finsegmentet, anvands for att 
samtidigt hamta OverlappningsbedOmningsvarden i en fOrsta 
tabell for Overlappande bildpunkter som tillhOr det 
fOrsta och det andra finsegmentet, och varvid den andra 
deladressen, som bestar av bildpunktsvardena fran det 
fOrsta och det tredje finsegmentet anvands for att sam- 
tidigt hamta OverlappningsbedOmningsvarden i en andra 
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sattet enligt uppfinningen kan anvandas for att 
undersfcka samtliga mSjliga f 6rskjutningspositioner eller 
endast en utvald del av dessa. 

Uppfinningen ar tillampbar vid alia typer av match- 
ning av bilder. Uppfinningen ar i synnerhet tillampbar 
nar man har ett krav pA hog matchningshastighet . 
Kort beskrivning av rltninqarna 

Ett exempel pS hur uppfinningen kan realiseras be- 
skrivs i det foljande under hanvisning till bifogade 
schematiska ritningar. 

Fig 1 visar en bild som bestar av ett flertal bild- 
punkter, med ett grovsegment och ett finsegment marke- 
rade . 

Fig 2 visar en tankt overlappning mellan tva bilder. 

Fig 3 visar hur en adress bildas med hjalp av bild- 
punktsvarden frSn ett flertal Gverlappande bildpunkter i 
tvS bilder. 

Fig 4 visar hur Sverlappningsbedomningsvarden for 
ett flertal olika f orskjutningspositioner lagras och 
hamtas samtidigt. 

Fig 5 visar hur SverlappningsbedSmningsvardena be- 
raknas fCr olika f Orskjutningspositioner . 

Fig 6 visar hur SverlappningsbedSmningsvarden lagras 
och hamtas i fallet med anvandning av deladresser. 

Fig 7 visar hur Cverlappningsvarden for ett flertal 
olika fSrskjutningspositioner adderas samtidigt. 
Beskrivning av en fSredraqen utfaringsf orm 

I det fSljande beskrivs ett far narvarande fOre- 
draget utfOrande av ett satt for matchning av tvA bilder 
av kroppsspecifika monster, varvid bilderna har delvis 
Sverlappande innehAll. Syftet med sattet Sr att finna den 
Sverlappningsposition som ger basta mSjliga Gverensstam- 
melse mellan bildernas innehSll och att bedSma graden av 
overensstammelse i denna position. FGr att bestamma vad 
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som utger basta mojliga Overenstammelse anvands ett pa 
forhand bestamt bedomningskriterium. 

I detta exempel genomfbrs sattet i mjukvara med 
hjalp av en 32-bitars processor med en klockf rekvens av 
5 100 Mhz och med ett 16 kB cache-minne, i vilket bilderna 
som skall matchas lagras. Ett exempel pa en processor av 
denna typ ar StrongARM fran Digital. Processorn arbetar 
under styrning av ett program som lases in i processorns 
programminne . 

10 Hur bilderna tas upp och matas in i processorns 

cache-minne ligger utanfor ramen for fbreliggande uppfin- 
ning och beskrivs darfSr inte narmare. Ett satt att ar 
dock att anvanda samma teknik som i kanda passersystem, 
namligen att registrera bilderna med en ljuskanslig, tva- 

15 dimensionell sensor och lagra dem i nagot minne, fran 
vilket processorn kan lasa in bilderna till sitt cache- 
minne . 

I fig 1 visas schematiskt en digital bild 1 som 
bestar av ett flertal bildpunkter 2 av vilka nagra ar 
20 schematiskt indikerade som rutor. Denna bild skall . 
matchas mot en likadan bild med delvis samma innehall. 

Bilden ar 55 bildpunkter bred och 76 bildpunkter 
hog. Den lagras som en bitmapp, varvid varje bildpunkt 
alltsa har vardet ett eller noli. I detta exempel rep- 
25 resenterar vardet ett en svart punkt och vardet noil en 
vit punkt. 

For genomforande av sattet delas varje bild in i 
elva grovsegment 3 i form av vertikala band, vilka var 
och en ar fern bildpunkter breda och 7 6 bildpunkter h6ga. 
30 Varje grovsegment delas in i finsegment 4 som vart och 

ett bestar av en horisontell rad av fern angransande bild- 
punkter. 

Grovsegmenten 3 anvands fttr att definiera ett fler- 
tal grovforskjutningspositioner. I fig 2 visas en fOrsta 
35 grovforskjutningsposition, i vilken tva bilder la och lb 
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Sr sA fOrskjutna i fOrhSllande till varandra att ett 
grovsegment 3, som markeras med snedstreckade linjer, 
frSn respektive bild bverlappar varandra. I en andra 
grovfOrskjutningsposition kommer tvk grovsegment fr&n 
respektive bild Overlappa varandra osv. upp till en elfte 
grovforskjutningsposition i vilken samtliga grovsegment 
overlappar varandra, Skillnaden mellan tv& angransande 
grovforskjutningspositioner ar sSledes ett grovsegment. 

I varje grovsegment definieras fyra finforskjut- 
ningspositioner . Dessa representerar en forskjutning i 
forhSllande till en grovf Orskjutningsposition med en, 
tv4, tre resp fyra bildpunktskolumner . 

GrovfOrskjutnings- och f inforskjutningspositionerna 
representerar forskjutningar mellan bilderna i en forsta 
riktning, namligen i horisontell led. Om bilderna aven 
kan vara fOrskjutna i fOrhallande till varandra i ver- 
tical led definieras ett antal vertikalf orskjutningsposi- 
tioner, varvid varje vertikalfdrskjutningsposition rep- 
resenterar en forskjutning med en bildpunktsrad i ver- 
tikal led. I fig 3 visas i den vanstra delen av figuren 
en vertikalfdrskjutningsposition for en fOrsta bild la 
och en andra bild lb, som ar visad med streckade linjer i 
Overlappningsiaget . 

Finsegmenten 4 anvSnds f5r att bestSmma ett antal 
10-bitars deladresser som i sin tur anvands fttr att hamta 
p§ fSrhand utraknade OverlappningsbedOmningsvarden, som 
vart och ett ger ett mitt pS graden av Overensstammelse 
mellan en eller flera Overlappande bildpunkter for en 
viss fOrskjutningsposition. En fOrsta deladress bildas 
genom att de fern minst signifikanta bitarna till adressen 
hamtas frkn ett fOrsta finsegment 4a i den forsta bilden 
la och de fern mest signifikanta bitarna hamtas fr&n mot- 
svarande Overlappande finsegment 4b i den andra bilden 
lb. Den fOrsta deladressen representerar alltsS vardet 
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for Overlappande bildpunkter, som man vill jamfOra for 
att kontrollera graden av Overensstammelse av innehallet. 

I fig 3 visas ett exempel pa hur det forsta finseg- 
mentet 4a om fern bitar "10010" hamtas fran den ena bilden 
5 la och det andra finsegmentet 4b om fem bitar "01100" 
hamtas fran den andra bilden lb och satts samman till 
adressen "0110010010". 

De forsta deladresserna anvands for att adressera 
tva tabeller med vardera 1024 rader (antalet mOjliga 
10 olika adresser) . Tabellerna visas schematiskt som Tabell 
1 och Tabell 2 i fig 4. I tabellerna, som liksom bilderna 
lagras i processorns cache-minne, finns pi fOrhand utrak- 
nade overlappningsbedOmningsvarden (nedan kallade poang) , 
vilket schematiskt visas i fig 4 genom en fOrstoring av 
15 en rad i vardera tabellen. 

I detta exempel ar poangsattningen den foljande. Tva 
overlappande vita bildpunkter ger en poang, tva overlap- 
pande svarta bildpunkter ger tva poang, medan en vit och 
en svart overlappande bildpunkt ger noil poang. 
20 i fig 5 visas de poanger som lagras i tabellerna i 

fig 4 pa raden med adressen "0110010010" och hur dessa 
beraknas. Poang 0 lagras i Tabell 2 och Poang 1-4 i 
Tabell 1. FOr varje overlappande bildpunkt erhalles en 
poang .i enlighet med ovan angivna poangsattning. Poangen 
25 for alia Overlappande bildpunkter summeras for astadkom- 
mande av den totala poang eller det overlappningsbedom- 
ningsvarde som skall lagras i tabellen pa raden med den 
aktuella adressen. 

I Tabell 2 i fig 4 finns for varje adress lagrat den 
30 poang (Poang 0) som erhalles nar de bada finsegmenten 
overlappar varandra helt, dvs den overlappning som er- 
halles i grovforskjutningspositionen. Denna poang ar en 
summa av poangen for fem Overlappande bildpunkter och ar 
lagrad i en byte. I Tabell 1 finns for varje adress lag- 
35 rat de poanger (Poang 1-4) som erhalles nar de bada fin- 
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segmenten fOrskjuts delvis i fOrhallande till varandra, 
dvs motsvarande olika f inf Orskjutningspositioner . Dessa 
poanger lagras i var sin byte i ett 32-bitars ord och kan 
saledes hamtas samtidigt med en lasning eller ett tabell- 
uppslag under en klockcykel. Poang 1 avser den poang som 
erhalles nfir finsegmenten fOrskjuts ett steg i fOrhal- 
lande till varandra, sa att bara fyra Overlappande bild- 
punkter erhalles. Poang 2 avser den poang som erhalles 
nar finsegmenten fOrskjuts tva steg i fOrhallande till 
varandra, sa att bara tre Overlappande bildpunkter er- 
halles osv. FOrskjutningarna aterspeglar den overlappning 
som erhalles i finfOrskjutningspositionerna mellan den 
aktuella grovfOrskjutningspositionen och foljande grov- 
fOrskjutningsposition. 

Sasom framgar av ovanstaende avser de Overlappnings- 
bedomningsvarden som hamtas med den forsta deladressen 
bara Overlappningar mellan bildpunkterna i det forsta och 
det andra finsegmentet for de undersokta fOrskjutnings- 
positionerna. Overlappningarna som sker i dessa f Orskjut- 
ningspositioner mellan bildpunkterna i det forsta finseg- 
mentet och andra bildpunkter an de i det andra finsegmen- 
tet fangas inte upp med hjalp av ovan beskrivna fOrfa- 
rande . 

FOr att kunna undersOka aven dessa Overlappningar 
bildas utover den fOrsta deladressen aven en andra del- 
adress. Denna andra deladress bestar av de fern bild- 
punktsvardena i det forsta finsegmentet 4a och dessutom 
fern bildpunktsvarden for ett tredje finsegment 4c som 
gransar till det andra finsegmentet i den andra bilden lb 
och som Overlappar det fOrsta finsegmentet i den foljande 
grovforskjutningspositionen. 

I fig 6 visas ett exempel pa hur den andra del- 
adressen bildas. Bildpunktsvardena "10010" fran det 
fOrsta finsegmentet 4a i den fOrsta bilden la utgOr de 
fern mest signifikanta bitarna i den andra deladressen, 
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medan bildpunktsvardena "10101" fran det tredje finseg- 
mentet 4c i den andra bilden lb utgOr de fern minst sig- 
nifikanta bitarna i den andra deladressen. 

Poangen eller overlappningsbedomningsvardena fOr de 
bildpunkter i det fOrsta och det tredje finsegmentet som 
Overlappar varandra i olika f orskjutningspositioner, 
lagras i en tredje tabell, som i fig 7 betecknas Tabell 
3. Poangen raknas givetvis ut pa samma satt som i fallet 
med Tabell 1, men poangen lagras i "omvand ordning". I 
den fOrsta byten pa en tabellrad i Tabell 3 lagras nam- 
ligen Poang 4, som avser en Overlappande bildpunkt mellan 
det fOrsta och det tredje finsegmentet. I den andra byten 
lagras Poang 3, som avser tva Overlappande bildpunkter 
mellan det forsta och det tredje f insegmentet osv. 

Med hjalp av den fOrsta och den andra deladressen 
kan man pa detta satt hamta Overlappningsvarden for fyra 
finforskjutningspositioner. Genom att summera" overlapp- 
ningsvardena fftr den fdrsta och den andra deladressen far 
man fram ett bverlappningsvarde ffir varje f orskjutnings- 
position. Vart och ett av dessa Overlappningsvarden avser 
fern Overlappande bildpunkter for den aktuella farskjut- 
ningspositionen . 

I fig 7 visas Tabell 1 och Tabell 3, en fOrsta och 
en andra deladress som anvands for att adressera dessa 
tabeller och overlappningsbedomningsvardena pa varsin rad 
i tabellen. 

I det fOljande beskrivs hur matchningen mellan bil- 
derna utfOrs. FOrst valjs en fOrsta grovforskjutnings- 
position. F6r denna position valjs ett forsta par av 
Overlappande finsegment. Antag att det fOrsta f inseg- 
mentet i den forsta bilden har bildpunktsvardena "10010" 
och att det andra finsegmentet i den andra bilden har 
bildpunktsvardena "01100", sasom i exemplet i fig 3. 
Dessa varden anvands fOr att bilda den fOrsta binara 
deladressen "0110010010". Antag vidare att ett tredje 
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finsegment som gransar till det andra f insegmentet i den 
andra bilden har vardena "10101". Dessa varden anvands 
for att tillsammans med bildpunktsvardena fOr det fOrsta 
finsegmentet bilda den andra deladressen "1001010101". 
Den fOrsta deladressen anvands for att adressera b&de den 
fOrsta och den andra tabellen. FrAn den fOrsta tabellen 
ffis i det givna exemplet poangerna 4, 3, 0 och 1 lagrade 
i ett ord och frSn den andra tabellen erhSlles poangen 1. 
Den andra deladressen anvands for att adressera den 
tredje tabellen, frin vilken poangerna 2, 0, 3, 3 f<§s i 
det givna exemplet. Poangerna summeras parallellt, varvid 
totalpoangerna 6, 3, 3 f 4 erhSlles. 

Nar dessa fOrsta Overlappande finsegment har jam- 
fOrts med varandra, fortsatter matchningen med tvS nya 
Overlappande finsegment, tills en fullstandig jamforelse 
mellan det eller de Overlappande grovsegmenten har ut- 
fOrts. 

Varje ghnq ett ord erhalles med de fyra summerade 
poangerna for tvS deladresser adderas ordet till tidigare 
erh&llna ord. Poangen for fyra olika f orskjutningsposi- 
tioner adderas alltsi parallellt genom en enda addition. 
Eftersom poangen ar Uga kan ett stort antal additioner 
genomfOras innan det uppkommer nSgon Overf Oringssif f ra 
(carry) och innan nigon undanlagring pS annan plats s&- 
ledes behOver gOras. Poangen fr£n den andra tabellen 
adderas pS motsvarande satt. I fig 8 visas schematiskt 
hur poangen for fyra f Orskjutningspositioner adderas 
parallellt, varvid ordet A representerar det ord som 
erh&lles med en fOrsta adress, bestSende av en fOrsta och 
en andra deladress, och ordet B representerar det ord som 
erhalles med en andra adress, bestSende av en fOrsta och 
en andra deladress, och ordet C den erhSllna summan. 

Nar samtliga Overlappande finsegment har undersOkts 
for den fOrsta grovfOrskjutningspositionen, upprepas 
fOrfarandet for den andra och fOljande grovf Orskjutnings- 
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positioner tills samtliga grovf orskjutningspositioner 
undersokts . 

Om bilderna aven kan vara fOrskjutna i vertikal led 
i fOrh&llande till varandra, upprepas sattet for varje 
5 vertikalposition, varvid bilderna alltsA forst fOrskjuts 
en rad i fOrhSllande till varandra i vertikal led och 
darefter samtliga grovfOrskjutnings- och finforskjut- 
ningspositioner undersOks, varefter bilderna fOrskjuts 
till nasta vertikalforskjutningsposition och undersOks 
10 och sh vidare tills samtliga vertikalf Orskjutningsposi- 
tioner har avsOkts. 

Nar samtliga f Orskjutningspositioner har undersokts 
har man erhallit en poangsumma for varje position. Med 
det bedOmningskriterium som anvands i detta exempel rep- 
15 resenterar dfi den stOrsta poangsumman den f Orskjutnings- 
position som ger den basta Overlappningen mellan inne- 
hallet i bilderna. Om en fOrsta bild jamfors med flera 
andra bilder anger den poangen den andra bild som bast 
overensstammer med den fOrsta bilden. 
20 I ett fOr narvarande fOredraget utfOrande av uppfin- 

ningen utfOrs fOrst en OverlappningsbedOmning p& det ovan 
beskrivna sattet med en grOvre upplOsning hos bilderna an 
den med vilken de ar lagrade . I detta exempel anvands en 
upplOsning av 25 x 30 bildpunkter. Syftet med detta ar 
25 att man snabbt ska valja ut relevanta f Orskjutningsposi- 
tioner f6r noggrannare undersOkning av Overensstammelsen 
mellan inneh&llet i bilderna. Darefter upprepas sattet 
for bilderna i dessa och angransande fOrskjutningsposi- 
tioner fOr den ursprungliga upplOsningen . 
30 I ovanstSende exempel lagras OverlappningsbedOm- 

ningsvardena i tre olika tabeller. Detta har skett fOr 
att utnyttja den anvanda processorn pS ett optimalt satt. 
For andra processorer kan det vara ISmpligt att istailet 
lagra alia Overlappningsvardena i en tabell eller i fler 
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an tre tabeller. Fackmannen kan gOra denna bedOmning med 
utgangspunkt fran beskrivningen ovan. 
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PATENT KRAV 

1. Satt att matcha tva bilder av kroppsspecif ika 
monster, vilka bilder var och en bestar av ett flertal 
5 bildpunkter och har delvis dverlappande innehall, varvid 
graden av 6verensstammelse mellan bildernas innehall be- 
stams for olika forskjutningspositioner som representerar 
olika overlappningar mellan bilderna, innefattande stegen 
att 

10 - bestamma ett flertal tal for var och en av ett 

flertal forskjutningspositioner, vilka tal vart och ett 
bildas med hjalp av bildpunktsvarden fran bada bilderna, 

- anvanda vart och ett av talen for att samtidigt fa 
fram i forvag definierade overlappningsbedomningsvarden 

15 for minst tva forskjutningspositioner, och 

- anvanda &verlappningsbeddmningsvardena vid bestam- 
ningen av graden av overensstammelse mellan bilderna for 
de olika forskjutningspositionerna . 

2. Satt enligt krav 1, vidare innefattande stegen 
20 att summera overlappningsbedomningsvardena for var och en 
av namnda forskjutningspositioner, och att anvanda de sa- 
lunda erhallna summorna for bestamning av vilken av for- 
skjutningspositionerna som ger den basta mojliga overens- 
stammelsen mellan innehallet i bilderna. 
25 3. Satt enligt krav 1 eller 2, varvid overlappnings- 

bedomningsvardena summeras parallellt for ett flertal 
forskjutningspositioner. 

4. Satt enligt nagot av foregaende krav, varvid 
vissa av overlappningsbedomningsvardena avser mer an en 

30 dverlappande bildpunkt. 

5. Satt enligt nagot av krav 1-4, varvid namnda 
flertal forskjutningspositioner f6r vilka talen bestams 
utgor grovforskjutningspositioner och namnda minst tva 
f&rskjutningspositioner for vilka 6verlappningsbed6m- 

35 ningsvarden hamtas innefattar minst en f inforskjutnings- 
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position som representerar en mindre forskjutning fran en 
grovforskjutningsposition an forskjutningen mellan tva 
grovf orskjutningspositioner . 

6. Satt enligt krav 5, varvid grovf orskjutningsposi- 
tionerna representerar olika 6verlappningar mellan bil- 
derna i en forsta riktning och vidare innefattande steget 
att upprepa sattet for olika dverlappningar mellan bil- 
derna i en andra riktning. 

7. Satt enligt krav 5 eller 6, varvid grovf 6rsk jut - 
ningspositionerna bestams genom att bilderna delas in i 
ett flertal grovsegment som bestar av N x M bildpunkter 
dar N och M ar stdrre an ett, varvid forskjutningen mel- 
lan tva angransande grovf orskjutningspositioner utgors av 
ett grovsegment . 

8. Satt enligt nagot av foregaende krav, varvid bil- 
derna utgdrs av bitmappar. 

9. Satt enligt nagot av foregaende krav, varvid 
talen utgor adresser till minnesplatser som lagrar namnda 
overlappningsbedomningsvarden som utgdrs av i forvag ut- 
raknade varden. 

10. Satt enligt krav 9, varvid adresserna anvands 
for att adressera minst en uppslagstabell som, for varje 
adress, innehaller de i forvag utraknade overlappnings- 
bedomningsvardena for minst tva f orskjutningspositioner . 

11. Satt enligt krav 10, vilket satt genomfors med 
hjalp av en processor som arbetar med en forutbestamd 
ordlangd och varvid namnda minst en uppslagstabell inne- 
fattar ett flertal adresserbara rader, som var och en har 
den forutbestamda ordlangden och lagrar namnda i forvag 
utraknade fiverlappningsbedomningsvarden. 

12. Satt enligt krav n, varvid lagringen av dver- 
lappningsbedomningsvardena utffirs pa sa satt att samtliga 
overlappningsbeddmningsvarden samt bilderna som ska 11 
matchas ryms i ett cache -minne i processorn. 
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13. Satt enligt nagot av foregaende krav, vidare 
innefattande steget att bilda varje tal av ett forsta 
finsegment, som innef attar minst tva angransande bild- 
punktsvarden fran den f6rsta bilden, och av ett andra 
finsegment, som overlappar det forsta finsegmentet och 
som innefattar lika manga angransande bildpunktsvarden 
som det forsta finsegmentet fran den andra bilden, samt 
av ett tredje finsegment, som innefattar lika manga an- 
gransande bildpunktsvarden som det f6rsta finsegmentet 
fran den andra bilden och som dverlappar det fdrsta fin- 
segmentet i en intilliggande forskjutningsposition for 
vilken bestamningen av ett flertal tal utfors. 

14. Satt enligt krav 13 i kombination med krav 9, 
varvid varje adress delas upp i en forsta och en andra 
deladress, varvid den forsta deladressen som bestar av 
bildpunktsvardena fran det forsta och det andra fin- 
segmentet, anvands for att samtidigt hamta 6verlappnings- 
bedomningsvarden i en forsta tabell for overlappande 
bildpunkter som tillhor det forsta och det andra fin- 
segmentet, och varvid den andra deladressen, som bestar 
av bildpunktsvardena fran det forsta och det tredje fin- 
segmentet anvands for att samtidigt hamta overlappnings- 
bedomningsvarden i en andra tabell f6r overlappande bild- 
punkter som tillhor det forsta och det tredje finsegmen- 

25 tet. 

15. Satt enligt krav 14, varvid den fdrsta och den 
andra tabellen, for varje adress, lagrar ett overlapp- 
ningsbedomningsvarde for var och en av namnda minst tva 
forskjutningspositioner, och varvid summan av overlapp- 

30 ningsbeddmningsvardena for en forsta forskjutningsposi- 
tion som hamtas med en adress forsta och andra deladress 
utgor ett overlappningsbedomningsvarden for samtliga 
overlappande bildpunkter mellan det forsta, det andra och 
det tredje finsegmentet f6r namnda forsta forskjutnings- 

35 position. 
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16. Satt enligt nAgot av f&reg&ende krav, varvid 
graden av Sverensstammelse mellan bilderna forst bestams 
med en forsta upplosning hos bilderna for val av ett 
flertal f orskjutningspositioner , och darefter bestams med 
en andra, hogre upplosning hos bilderna for de valda for- 
skjutningspositionerna och angrSnsande forskjutningsposi- 
tioner . 

17. Anordning fdr matchning av tv& bilder som var 
och en bestir av ett flertal bildpunkter och som har del- 
vis overlappande innehall, kannetecknad av 
en processorenhet som &r anordnad att genomfora ett s§tt 
enligt n&got av kraven 1-16, 

18. Anordning for matchning av tvS bilder som var 
och en best&r av ett flertal bildpunkter och som har del- 
vis overlappande innehall, vilken anordning innef attar 
ett minnesmedium, vilket ar avlasningsbart med hjalp av 
en dator och pi vilket ar lagrat en datorprogram for 
genomf6rande av sattet enligt n&got av kraven 1-16. 



2000 -03- 3C 1^:31 \ \s-7tl-. -pdc - CI \^zox.p&$ \ pat \cH\a.i8\l 9 -J7\p29 73 50 3 . doc 



513 058 



FIG.I 

2 4 2 



I: 



>7b 



Y 

55 = 5-11 



FIG.2 




1b 



.J 



513 058 



1 FIG.3 




FIG.5 



Poang 0 



] 



HQ 



0+0+0+0+1=1 



Poang 1 



] 



1+0+2+1=4 



Poang 2 



1+2+0 = 3 



Poang 3 



0+0 = 0 



Poang 4 



led 



1:1 



S13 058 



FIG.4 



TABELL 1 



4b 
< 



4a 



1023 : 



EfflTh cr ffi a m TD j -u ^rn . m 

* * * * 



I PoSng 1 I PoSng 2 Poang 3 1 Poang 4 



TABELL 2 



0 

1 
1 
1 
1 
1 






1 
1 
1 
1 
1 

1 

1 








1 






Po^ng 0 


» 

i 

1023 







513 058 



FIG.6 

r : j 




FIG.8 



A 


Poang la 


Poang 2a 


Poang 3a 


i 

Poang 4a 1 






B 

+ 


Poang lb 


Poang 2b 


Poang 3b 


PoSng 4b I 


C 


Poang lc 


Poang 2c 


Poang 3c 


PoSng 4c 1 



The European Patent Office 



Declaration 



I, the undersigned Margareta Backen, technical translator, of Bellevue- 



vagen 46, Malmo, Sweden, do hereby declare that I am conversant with the English and 
Swedish languages and am a competent translator thereof, and I further declare that to the 
best of my knowledge and belief the following is a true and complete translation made 
by me of the Swedish Patent Application No. 9704925-8 filed on the 30th of December 
1997 by Precise Biometrics AB, Lund, Sweden. 



Signed this 2nd day of September 2003 




Margareta Backen 



Translation 

PRV 

THE SWEDISH PATENT AND REGISTRATION OFFICE 

Patent Department 



Certificate 

This is to certify that the annexed documents are true copies of the docu- 
ments originally filed with the Swedish Patent and Registration Office in the 
following Application. 



) (Seal of 

the Patent Applicant(s) Precise Biometrics AB, Lund SE 

Office) 



Patent Application No. 9704925-8 



Filing Date 30 December 1997 



Stockholm, 26 June 2000 



For the Patent and Registration Office 

Emma Hogberg 
Emma Hogberg 

Fee SEK 170 



THE PATENT AND Postal address 

REGISTRATION OFFICE box soss 

SWEDEN S-102 42 STOCKHOLM 



Telephone 
+46 8 782 25 00 
08 782 25 00 



Telex 
17978 



Telecopier 
+46 8 666 02 86 
08 666 02 86 



9704925-8 



Received in the Patent Office 
on 30 December 1997 



1 



A METHOD AND A DEVICE FOR MATCHING IMAGES OF 
BODY-SPECIFIC PATTERNS 



Field of the Invention 

The present invention relates to a method and a 
device for matching two images of body-specific patterns, 
each image consisting of a plurality of pixels and having 
5 partially overlapping contents, the degree of correspon- 
dence between the images being determined for different 
displacement positions which represent different overlap- 
pings of the images. 
Background of the Invention 

10 It has been known for hundreds, maybe even thou- 

sands, of years that a person's fingerprints are unique 
and therefore can be used to identify the person in ques- 
tion. Up to now the technique has been used mostly to 
identify criminals, but it is also known to use it in, 

15 for instance, access control systems. When using the 

technique in an access control system, the person who is 
to be accepted for access presses his finger against a 
surface, and an image of the fingerprint is made. This 
image is compared with a number of prestored fingerprint 

20 images for accepted persons in order to decide whether 

the person in question should be allowed to enter or not. 

In this comparison use is normally made of a feature 
extraction, which means that certain characteristic ele- 
ments in the print are identified and that the elements 

25 and their relative distance are compared with correspond- 
ing data for the prestored fingerprints. A difficulty 
arising in the comparison is that the fingerprint is 
usually not in the same position in the image that is 
made when the identification is to be carried out as in 

30 the prestored image of the fingerprint. 

It goes without saying that the security in the 
system increases the more data are examined, but on the 
other hand also the time needed for the identification 
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increases. Therefore there is a great need of a method 
of fast and effective matching of fingerprints. 

Recently other body-specific patterns, such as hand- 
and footprints, and iris patterns have come into use for 
the identification of people. In these applications, 
there is of course the same need of fast matching of 
images . 

A possible method for matching two images of body- 
specific patterns is to examine all possible overlap 
positions between the images and, for each overlap posi- 
tion, to examine every pair of overlapping pixels, to 
determine a score for each pair of overlapping pixels, 
the score depending on how well the values of the pixels 
correspond, and to then determine which overlap position 
provides the best match on the basis of the total of the 
scores for the overlapping pixels in each position. How- 
ever, this procedure is too slow for the application 
indicated above. 
Summary of the Invention 

In the light of the above, one object of the pre- 
sent invention is thus to provide a new method for auto- 
matic matching of two images of body-specific patterns, 
which method permits faster matching of the images with 
a given processor than the method described above. 

A further object is to provide a device for the 
implementation of the method. 

The objects are achieved by a method according to 
claim 1 and a device according to claim 17 and claim 18. 
Preferred embodiments are stated in the subclaims. 

Like the method described above, the invention is 
based on determining the degree of correspondence between 
two images of body-specific patterns, each image consist- 
ing of a plurality of pixels and having partially over- 
lapping contents, for different displacement positions 
representing different overlappings of the images. How- 
ever, the comparison of the contents of the images is 
effected in a more efficient manner. More specifically, 
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a plurality of numbers are determined for each one of a 
plurality of displacement positions, each number being 
formed with the aid of pixel values from both images. 
The numbers are used to retrieve predefined overlap 
assessment values for at least two displacement posi- 
tions simultaneously. These overlap assessment values 
are subsequently used in determining the degree of cor- 
respondence between the contents of the images . 

By this method, the different displacement posi- 
tions can be examined with a certain degree of paral- 
lelism, making it possible to examine the images more 
quickly than if all the displacement positions are exa- 
mined sequentially. This parallelism is achieved with the 
aid of the numbers, which are used to examine at least 
two displacement positions simultaneously. Since the num- 
bers are based on the contents of each image, it is pos- 
sible to calculate in advance the overlap assessment 
values in the cases where the pixel values which make up 
the numbers overlap completely or partially. Naturally, 
the efficiency increases the more pixels are included in 
each number since this increases the parallelism. 

Thus, the overlap assessment values are predefined. 
What this means is that if a pixel in one of the images 
has a first given value and the corresponding overlapping 
pixel in the other image has a second given value, a cer- 
tain predetermined overlap value is always obtained . The 
same applies when the overlap assessment values relate to 
several overlapping pixels. The different overlap assess- 
ment values which are obtained for different combinations 
of pixel values can be determined optionally. They can be 
defined by means of one or more formulae or tables or in 
some other suitable manner. 

In this connection, it should be pointed out that, 
of course, the images are not physically displaced in 
relation to each other when the method is being imple- 
mented, but rather the comparison between the images is 
carried out for hypothetical displacements . 
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In a preferred embodiment, the method furthermore 
comprises the steps of adding up the overlap assessment 
values for each of said displacement positions, and of 
using the totals obtained in this manner to determine 
which of the displacement positions provides the best 
possible match between the contents of the images. The 
overlap assessment values which are added together for 
a certain displacement position preferably reflect the 
degree of correspondence between all overlapping pixels 
for that displacement position. 

In order further to increase the matching speed, the 
overlap assessment values are suitably added up in paral- 
lel for several displacement positions. The adding-up 
becomes particularly advantageous if it is carried out 
in parallel for the overlap assessment values which are 
retrieved simultaneously with the aid of a number. 

Each overlap assessment value can relate to one or 
more overlapping pixels. In the latter case, a matching 
speed increase is achieved by the fact that it is not 
necessary to add up the assessment values for each over- 
lapping pixel for a certain displacement position, but 
rather overlap assessment values which have already 
been added up for two or more overlapping pixels can 
be retrieved directly. 

The plurality of displacement positions for which 
numbers are determined can suitably constitute rough 
displacement positions, and said at least two displace- 
ment positions for which the overlap assessment values 
are retrieved directly can suitably comprise at least one 
fine displacement position, representing a smaller dis- 
placement from a rough displacement position than the 
displacement between two rough displacement positions. 
The second retrieved overlap assessment value can relate 
to the rough displacement position in question or to 
another fine displacement position. 

In the simplest embodiment of the method, the con- 
tents of the images are displaced in relation to each 
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other in one direction only. However, the method can also 
be employed when the images are displaced in two diffe- 
rent, preferably perpendicular, directions in relation to 
each other. In this case, in order to arrive at the posi- 
5 tion in which the correspondence between the contents of 
the images is at a maximum, it is suitable to let the 
rough displacement positions represent different overlap- 
pings of the images in the first direction, for example 
horizontally, and to repeat the method for different 

10 overlappings of the images in the other direction, for 
example vertically . 

The rough displacement positions, which thus consti- 
tute a subset of the displacement positions examined, are 
preferably determined by the images being divided into a 

15 plurality of rough segments consisting of N x M pixels 
where N and M are greater than one, the displacement 
between two adjoining rough displacement positions con- 
sisting of a rough segment. The rough segments can thus 
be achieved by the images being divided into columns or 

20 rows, each having the width and the height of several 
pixels . 

The images can be represented in various ways. They 
can be analogue, but it is preferable that they be digi- 
tal since this facilitates their processing with the aid 

25 of a computer. The pixel values can be represented with 
different resolutions. However, the method is preferably 
intended for images which are represented as bitmaps. 

As mentioned above, the numbers are based on the 
contents of the two images. In a preferred embodiment the 

30 numbers are used as addresses for memory locations, which 
store the overlap assessment values. In this case, the 
latter are suitably defined by quite simply being calcu- 
lated or determined in advance . 

Preferably, the addresses are used for addressing a 

35 lookup table which, for each address, contains said pre- 
calculated overlap assessment values for at least two 
displacement positions. The order in which the pixels 
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values are used in the address is of no importance as 
long as the same order is used for all addresses and as 
long as the storing of the overlap assessment values in 
the lookup table is carried out in a predetermined manner 
in relation to said order. 

The method according to the invention can be imple- 
mented entirely in hardware. In that case, the numbers 
can, for instance, form input signals for a gate circuit 
which has been designed in such a way that for each given 
set of input signals the corresponding overlap assessment 
values are produced as output signals. Thus, in this 
case, the overlap assessment values are defined by the 
design of the gate circuit. This method can be advanta- 
geous for large images. 

However, in a preferred embodiment, the method is 
implemented in software with the aid of a processor which 
works with a predetermined word length. In this case, the 
lookup table comprises a plurality of addressable rows, 
each of which has the predetermined word length and 
stores the pre-calculated overlap assessment values. By 
adjusting the width of the table to the word length of 
the processor, the best possible utilisation of the capa- 
city of the processor is obtained. For example, different 
rows in the table can be added up in an efficient manner. 

The various parameters for the method, i.e. the 
rough displacement positions, the number of overlap 
assessment values stored for each address, the number 
of tables, etc., are suitably determined on the basis 
of the processor utilised and its cache memory in order 
to achieve the highest speed possible. Preferably, the 
parameters are chosen so that the two images and all of 
the pre-calculated overlap assessment values can be con- 
tained in the cache memory. 

In a preferred embodiment, each number is formed 
by a first fine segment, which comprises at least two 
adjoining pixels values from the first image, and by a 
second fine segment, which overlaps the first fine seg- 
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ment and which comprises as many adjoining pixel values 
as the first fine segment from the second image, and a 
third fine segment, which comprises as many adjoining 
pixel values as the first fine segment from the second 
image and which overlaps the first fine segment in an 
adjacent displacement position for which the determina- 
tion of a plurality of numbers is carried out, i.e. an 
adjacent rough displacement position. In this way, the 
number will include all pixel values which can overlap 
in a rough displacement position and in all fine dis- 
placement positions between this rough displacement posi- 
tion and the subsequent rough displacement position, as 
well as in this subsequent rough displacement position. 
Accordingly, it is possible to retrieve, with the number, 
pre-calculated overlap assessment values for all of these 
displacement positions . 

In order to save memory space so that all necessary 
information can be stored in the cache memory of a pro- 
cessor and thus be quickly accessible, each address is 
advantageously divided into a first and a second. sub- 
address, the first subaddress, which consists of the 
pixel values from the first and the second fine segment, 
being used to simultaneously retrieve overlap assessment 
values in a first table for overlapping pixels belonging 
to the first and the second fine segment, and the second 
subaddress, which consists of the pixel values from the 
first and the third fine segment, being used to simulta- 
neously retrieve overlap assessment values in a second 
table for overlapping pixels belonging to the first and 
the third segment. 

In this case, for each address, the first and the 
second table preferably store an overlap assessment value 
for each one of said at least two displacement positions, 
the sum of the two overlap assessment values for a first 
displacement position, which is retrieved with the first 
and second subaddresses of an address, constituting an 
overlap assessment value for all overlapping pixels of 
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the first, the second, and the third fine segment for 
said first displacement position. The overlap assessment 
values are preferably stored in the same order with 
respect to the displacement positions for each address, 
5 so that they can be easily added up. 

In order further to increase the matching speed, 
the degree of correspondence between the images is first 
determined with a first resolution of the images for 
selection of a plurality of displacement positions and 

10 subsequently with a second, higher resolution of the 
images for the displacement positions selected and 
adjoining displacement positions. In this way, it is 
possible to reject whole areas of the image which are 
not of interest for further examination. 

15 More specifically, a device according to the inven- 

tion has a processing unit which is adapted to implement 
a method according to any one of claims 1-17. The pro- 
cessing unit can be connected to a unit for recording 
images and can process the images in real time. The 

20 device exhibits the same advantages as the method de- 
scribed above, that is, it permits a quicker matching 
of the images. 

In a preferred embodiment, the invention is imple- 
mented in the form of a computer program which is stored 

25 in a storage medium which is readable with the aid of a 
computer . 

The method according to the invention can be used 
to examine all possible displacement positions or only a 
selection . 

30 The invention is applicable to all types of match- 

ing of images. The invention is especially applicable 
when a high matching speed is required. 
Brief Description of the Drawings 

An example of how the invention can be implemented 

35 will be described below with reference to the accompany- 
ing schematic drawings. 
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Fig. 1 shows an image consisting of a plurality of 
pixels, with one rough segment and one fine segment indi- 
cated . 

Fig. 2 shows a hypothetical overlapping of two 
images . 

Fig. 3 shows how an address is formed with the aid 
of pixel values from a plurality of overlapping pixels 
in two images . 

Fig. 4 shows how the overlap assessment values for 
a plurality of different overlap positions are stored and 
retrieved simultaneously . 

Fig. 5 shows how the overlap assessment values are 
calculated for various displacement positions. 

Fig. 6 shows how overlap assessment values are stor- 
ed and retrieved in the case where subaddresses are em- 
ployed. 

Fig. 7 shows how overlap values for a plurality of 
different displacement positions are added up simulta- 
neously. 

Description of a Preferred Embodiment 

A presently preferred embodiment of a method for 
matching two images of body-specific patterns, the images 
having partially overlapping contents, will be described 
below. The purpose of the method is to find the overlap 
position which provides the best possible correspondence 
between the contents of the images and to assess the 
degree of correspondence in this position. In order to 
determine what constitutes the best possible correspon- 
dence, a predetermined assessment criterion is employed. 

In this example, the method is implemented in soft- 
ware with the aid of a 32-bit processor with a clock fre- 
quency of 100 MHz and with a 16 kB cache memory, in which 
the images which are to be matched are stored. An example 
of a processor of this type is StrongARM supplied by 
Digital. The processor operates under the control of a 
program which is read into the program memory of the pro- 
cessor . 
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The way in which the images are picked up and fed 
into the cache memory of the processor lies outside the 
scope of the present invention and will therefore not be 
described in more detail. One way, however, is to use the 
same technique as in prior-art access control systems, 
that is, to record the images with a light-sensitive, 
two-dimensional sensor and to store them in a memory, 
from which the processor can read the images into its 
cache memory. 

Fig. 1 schematically shows a digital image 1 con- 
sisting of a plurality of pixels 2 of which some are 
schematically indicated as squares. The image is to be 
matched with a like image with partially the same con- 
tents . 

The image is 55 pixels wide and 76 pixels high. It 
is stored as a bitmap, each pixel thus having the value 
one or zero. In this example, the value one represents 
a black dot and the value zero a white dot. 

For the implementation of the method, each image is 
divided into eleven rough segments 3 in the form of ver- 
tical bands, each being five pixels wide and 7 6 pixels 
high. Each rough segment is divided into fine segments 
4, each consisting of a horizontal row of five adjoining 
pixels . 

The rough segments 3 are employed to define a plu- 
rality of rough displacement positions. Fig. 2 shows a 
first rough displacement position, in which two images 
la and lb are displaced in relation to each other in such 
a way that one rough segment 3, indicated by slanting 
lines, from each image overlap one another. In a second 
rough displacement position, two rough segments from each 
image will overlap, etc. up to an eleventh rough dis- 
placement position in which all the rough segments over- 
lap. The difference between two adjoining rough displace- 
ment positions is thus one rough segment. 

In each rough segment, four fine displacement posi- 
tions are defined. These represent a displacement in 
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relation to a rough displacement position by one, two, 
three and four pixel columns. 

The rough displacement positions and the fine dis- 
placement positions represent displacements between the 
images in a first direction, viz. horizontally. If the 
images can also be displaced vertically in relation to 
each other, a number of vertical displacement positions 
are defined, each vertical displacement position repre- 
senting a displacement by one pixel row vertically. The 
left part of Fig. 3 shows a vertical displacement posi- 
tion for a first image la and a second image lb, which 
is indicated by dashed lines in the overlap position. 

The fine segments 4 are employed to determine a num- 
ber of 10-bit subaddresses which in turn are employed to 
retrieve pre-calculated overlap assessment values, each 
providing a measure of the degree of correspondence 
between one or more overlapping pixels for a certain dis- 
placement position. A first subaddress is formed by the 
five least significant bits of the address being retriev- 
ed from a first fine segment 4a in the first image la and 
the five most significant bits being retrieved from the 
corresponding overlapping fine segment 4b in the second 
image lb. The first subaddress thus represents the value 
for overlapping pixels which one wishes to compare in 
order to check the degree of correspondence with respect 
to contents. 

Fig. 3 shows an example of how the first fine seg- 
ment 4a of five bits "10010" is retrieved from the one 
image la and the second fine segment 4b of five bits 
"01100" is retrieved from the other image lb and are put 
together into the address "0110010010". 

The first subaddresses are employed to address two 
tables of 1024 rows each (the number of possible diffe- 
rent addresses) . The tables are shown schematically as 
Tables 1 and 2 in Fig. 4. In the tables, which like the 
images are stored in the cache memory of the processor, 
there are pre-calculated overlap assessment values (call- 
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ed scores in the following) . This is shown schematically 
in Fig. 4 by way of an enlargement of a row in each 
table . 

In this example, the scores are calculated as fol- 
5 lows. Two overlapping white pixels equal one point, two 
overlapping black pixels equal two points, while one 
white and one black overlapping pixel equal zero points. 

Fig. 5 shows the scores which are stored in the 
tables in Fig. 4 in. the row with the address "0110010010" 
10 and how these are calculated. Score 0 is stored in Table 
2 and Scores 1-4 are stored in Table 1 . For each overlap- 
ping pixel, a score is achieved in accordance with the 
scoring set out above. The scores for all overlapping 
pixels are added to arrive at the total score or the 
15 overlap assessment value which is to be stored in the 
table in the row with the address in question. 

Table 2 in Fig. 4 contains, for each address, the 
score (Score 0) achieved when the two fine segments over- 
lap completely, i.e. the overlapping which is obtained in 
20 the rough displacement position. This score is the total 
of the scores for five overlapping pixels and is stored 
in one byte. Table 1 contains, for each address, the 
scores (Scores 1-4) which are achieved when the two fine 
segments are partially displaced in relation to each 
25 other, i.e. corresponding to various fine displacement 

positions. These scores are stored in one byte each in a 
32-bit word and can accordingly be retrieved at the same 
time with one reading or one table lookup during one . 
clock cycle. Score 1 relates to the score achieved when 
30 the fine segments are displaced by one increment in rela- 
tion to each other, so that only four overlapping pixels 
are obtained. Score 2 relates to the score achieved when 
the fine segments are displaced by two increments in 
relation to each other, so that only three overlapping 
35 pixels are obtained, etc. The displacements reflect the 
overlapping obtained in the fine displacement positions 
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between the rough displacement position in question and 
the following rough displacement position. 

As can be seen from the above, the overlap assess- 
ment values which are retrieved using the first sub- 
address relate only to overlappings between the pixels 
in the first and the second fine segment for the dis-. 
placement positions examined. The overlappings which 
occur in these displacement positions between the pixels 
in the first fine segment and pixels other than the ones 
in the second fine segment are not picked up with the aid 
of the method described above . 

In order to permit the examination of these over- 
lappings as well, a second subaddress is formed in addi- 
tion to the first subaddress. This second subaddress con- 
sists of the five pixel values in the first fine segment 
4a as well as five pixel values for a third fine segment 
4c which adjoins the second fine segment in the second 
image lb and which overlaps the first fine segment in the 
subsequent rough displacement position. 

Fig. 6 shows an example of how the second subaddress 
is formed. The pixel values "10010" from the first fine 
segment 4a in the first image la constitute the five most 
significant bits of the second subaddress, while the 
pixel values "10101" from the third fine segment 4c in 
the second image lb constitute the five least significant 
bits in the second subaddress. 

The scores or the overlap assessment values for the 
pixels in the first and the third fine segment which 
overlap in different displacement positions are stored in 
a third table, which is indicated as Table 3 in Fig. 7. 
The scores are, of course, calculated in the same manner 
as in the case of Table 1, but the scores are stored in 
"reverse order". Accordingly, Score 4, which relates to 
one overlapping pixel of the first and the third fine 
segment, is stored in the first byte of a table row in 
Table 3. Score 3, which relates to two overlapping pixels 
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of the first and the third segment, is stored in the 
second byte, etc. 

In this way, overlap values for four fine displace- 
ment positions can be retrieved with the aid of the first 
and the second subaddress. By adding up the overlap 
values for the first and the second subaddress an overlap 
value is obtained for each displacement position. Each of 
these overlap values relates to five overlapping pixels 
for the displacement position in question. 

Fig. 7 shows Tables 1 and 3, a first and a second 
subaddress employed to address these tables, and the 
overlap assessment values in separate rows of the table. 

A description of how the matching of the images is 
performed is given below. First, a first rough displace- 
ment position is chosen. For this position, a first pair 
of overlapping fine segments is chosen. Suppose that the 
first fine segment in the first image has the pixel 
values "10010" and that the second fine segment in the 
second image has the pixel values "01100", as in the 
example in Fig. 3, These values are used to form the 
first binary subaddress "0110010010". Moreover, suppose 
that a third fine segment which adjoins the second fine 
segment in the second image has the values "10101". 
These values are used together with the pixel values for 
the first fine segment to form the second subaddress 
"1001010101". The first subaddress is employed to address 
both the first and the second table. In the example 
given, the scores 4, 3, 0, and 1 stored in one word are 
obtained from the first table and the score 1 is obtained 
from the second table. The second subaddress is employed 
to address the third table, from which the scores 2, 0, 
3, 3 are obtained in the example given. The scores are 
added up in parallel, the total scores 6, 3, 3, 4 being 
obtained . 

When these first overlapping fine segments have been 
compared, the matching continues with two new overlapping 
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fine segments, until a complete comparison between the 
overlapping rough segment or segments has been performed. 

Each time a word is obtained with the four scores 
added up for two subaddresses, the word is added to the 
words previously obtained. The scores for four different 
displacement positions are thus added up in parallel by 
means of one single addition. Since the scores are low, 
a large number of additions can be performed before there 
is a carry and, consequently, before any storing in a 
different location has to be done. The scores from the 
second table are added up in the same way. Fig. 8 schema- 
tically shows how the scores for four displacement posi- 
tions are added up in parallel, the word A representing 
the word obtained with a first address, consisting of a 
first and a second subaddress, and the word B represent- 
ing the word obtained with a second address, consisting 
of a first and a second subaddress, and the word C repre- 
senting the total obtained. 

When all overlapping fine segments have been examin- 
ed for the first rough displacement position, the proce- 
dure is repeated for the second and subsequent rough dis- 
placement positions until all rough displacement posi- 
tions have been examined. 

If the images can also be displaced vertically in 
relation to each other, the method is repeated for each 
vertical position, the images thus first being displaced 
one row vertically in relation to each other and subse- 
quently all rough and fine displacement positions being 
examined, whereupon the images are displaced to the next 
vertical displacement position and are examined and so on 
until all vertical displacement positions have been scan- 
ned. 

When all displacement positions have been examined a 
score will have been obtained for each position. With the 
assessment criterion used in this example, the highest 
score will represent the displacement position which pro- 
vides the best overlapping of the contents of the images. 
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If a first image is compared with a plurality of second 
images, the highest score indicates the second image 
which best corresponds with the first image. 

In a presently preferred embodiment of the inven- 
tion, an overlap assessment is first carried out in the 
manner described above with a lower resolution of the 
images than the one with which they are stored- In this 
example, a resolution of 25 x 30 pixels is used. The pur- 
pose of this is the quick selection of relevant displace- 
ment positions for closer examination of the correspon- 
dence between the contents of the images. Subsequently, 
the method is repeated for the images in these and ad- 
joining displacement positions for the original resolu- 
tion . 

In the above example, the overlap assessment values 
are stored in three different tables. This has been done 
in order to utilise the processor optimally. In the case 
of other processors, it may instead be suitable to store 
all overlap assessment values in one table or in more 
than three tables. This can be determined by the skilled 
person on the basis of the above description. 
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17 
CLAIMS 

1. A method for matching two images of body-specific 
patterns, each image consisting of a plurality of pixels 
and having partially overlapping contents, the degree of 
correspondence between the contents of the images being 
determined for different displacement positions which 
represent different overlappings of the images, compris- 
ing the following steps: 

- determining a plurality of numbers for each of a 
plurality of displacement positions, each number being 
formed with the aid of pixel values from both images, 

- using each number to retrieve predefined overlap 
assessment values for at least two displacement positions 
simultaneously, and 

- using the overlap assessment values in determining 
the degree of correspondence between the contents of the 
images for the different displacement positions. 

2. A method according to claim 1, further comprising 
the following steps: adding up the overlap assessment 
values for each of said displacement positions, and using 
the totals obtained in this manner to determine which of 
the displacement positions provides the best possible 
correspondence between the contents of the images. 

3. A method according to claim 1 or 2, wherein the 
overlap assessment values are added up in parallel for a 
plurality of displacement positions. 

4 . A method according to any one of the preceding 
claims, wherein some of the overlap assessment values 
relate to more than one overlapping pixel . 

5. A method according to any one of claims 1-4, 
wherein said plurality of displacement positions for 
which the numbers are determined constitute rough dis- 
placement positions and said at least two displacement 
positions for which overlap assessment values are 
retrieved comprise at least one fine displacement posi- 
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tion representing a smaller displacement from a rough 
displacement position than the displacement between two 
rough displacement positions. 

6. A method according to claim 5, wherein the rough 
5 displacement positions represent different overlappings 

of the images in a first direction, and further compris- 
ing the step of repeating the method for different over- 
lappings of the images in a second direction. 

7. A method according to claim 5 or 6, wherein the 
10 rough displacement positions are determined by the images 

being divided into a plurality of rough segments consist- 
ing of N x M pixels, where N and M are greater than one, 
the displacement between two adjoining rough displacement 
positions consisting of a rough segment. 
15 8 . A method according to any one of the preceding 

claims, wherein the images consist of bitmaps. 

9. A method according to any one of the preceding 
claims, wherein the numbers constitute addresses of 
memory locations, which store said overlap assessment 

20 values consisting of pre-calculated values. 

10. A method according to claim 9, wherein the 
addresses are employed to address at least one lookup 
table which, for each address, contains the pre-calcu- 
lated overlap assessment values for at least two dis- 

25 placement positions. 

11. A method according to claim 10, which method is 
performed with the aid of a processor working with a pre- 
determined word length and wherein said at least one 
lookup table comprises a plurality of addressable rows, 

30 each having the predetermined word length and storing 
said pre-calculated overlap assessment values. 

12. A method according to claim 11, wherein the 
storing of the overlap assessment values is performed in 
such a manner that all overlap assessment values as well 

35 as the images which are to be matched can be contained in 
a cache memory in the processor. 

-003-09-04 14:07 V:\_NoOrganisation\PP.ECISE BIOMETRICS 

AB\PATENT\_NoFaiaily\EP\2001594\2001594 Tiansl prior doc 9704 925-8.doc 



Received in the Patent Off 
on 30 December 1997 



19 

13. A method according to any one of the preceding 
claims, further comprising the step of forming each num- 
ber of a first fine segment, which comprises at least 
two adjoining pixel values from the first image, and of 

a second fine segment, which overlaps the first fine seg- 
ment and which comprises as many adjoining pixel values 
as the first fine segment from the second image, and of 
a third fine segment, which comprises as many adjoining 
pixel values as the first fine segment from the second 
image and which overlaps the first fine segment in an 
adjacent displacement position, for which the determina- 
tion of a plurality of numbers is carried out. 

14. A method according to claim 13 in combination 
with claim 9, wherein each address is divided into a 
first and a second subaddress, the first subaddress, 
which consists of the pixel values from the first and 
the second fine segment, being used to simultaneously 
retrieve overlap assessment values in a first table for 
overlapping pixels belonging to the first and the second 
fine segment, and the second subaddress, which consists 
of the pixel values from the first and the third fine 
segment, being used to simultaneously retrieve overlap 
assessment values in a second table for overlapping 
pixels belonging to the first and the third segment. 

15. A method according to claim 14, wherein, for 
each address, the first and the second table store an 
overlap assessment value for each one of said at least 
two displacement positions, and wherein the sum of the 
overlap assessment values for a first displacement posi- 
tion, which is retrieved using the first and second sub- 
addresses of an address, constitutes an overlap assess- 
ment value for all overlapping pixels between the first, 
the second, and the third fine segment for said first 
displacement position . 

16. A method according to any one of the preceding 
claims, wherein the degree of correspondence between the 
images is first determined with a first resolution of the 
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images for selection of a plurality of displacement posi- 
tions, and is subsequently determined with a second, 
higher resolution of the images for the displacement 
positions selected and adjoining displacement positions. 

17. A device for matching two images, each consist- 
ing of a plurality of pixels and having partially over- 
lapping contents, characterised by a process- 
ing unit which is adapted to implement a method according 
to any one of claims 1-16. 

18. A device for putting together two images, each 
consisting of a plurality of pixels and having partially 
overlapping contents, which device comprises a storage 
medium, which is readable with the aid of a computer and 
in which is stored a computer program for implementing 
the method according to any one of claims 1-16. 
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ABSTRACT 

In a method for matching two images of body-specific 
patterns, each image consisting of a plurality of pixels 
5 and having partially overlapping contents, the degree of 
correspondence between the contents of the images is 
determined for different displacement positions repre- 
senting different overlappings of the images. More speci- 
fically, a plurality of numbers are determined for each 

' 10 one of a plurality of said displacement positions. Each 

number is formed with the aid of pixel values from both 
images and is used to simultaneously retrieve predefined 

) overlap assessment values for at least two of said dis- 

placement positions. The overlap assessment values 
15 retrieved are subsequently used to determine the degree 
of correspondence between the images for the different 
displacement positions. The method is carried out with 
the aid of a computer and can be implemented as a com- 
puter program. 



) 



) 



Elected for publication: Fig. 3 
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